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ABSTRACT 

The Chapter 1 , Part B, Institutional Faci 1 it ies 
Program of the New York (New York) public schools was fully 
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academic remediation, and daily living skills instruction for 
approximately 500 students at 15 institutions for neglected and 
delinquent children. Eighty-two percent of the students mastered 80 
percent or more of their individual short-term objectives, surpassing 
the program goal. Descriptive evaluation of the program indicates 
that most teachers emphasized individual instruction and included 
small group instruction. Teachers generally developed instruction to 
meet the individual needs and interests of students. Program 
strengths include cooperative and supportive staff, successful use of 
computers and software, specialized programming for students, and 
excellent rapport between teachers and students. No major program 
weaknesses were observed, although some improvements have been 
suggested, especially in the areas of improved planning and the use 
of computer resources. Seven tables present evaluation findings. 
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Citywide Programs/District 75 

E.C.I. A. Chapter 1, Part B 
Institutional Facilities Program 



SUMMARY 



• The Chapter 1, Part B # Institutional 
Facilities program was fully 
implemented in summer 1993. 
During the six-week session, 
approximately 500 students 
received supplementary career 
education, academic remediation, 
and daily living skills instruction. 

• Eighty-two percent of the students 
mastered 80 percent or more of 
their individual short-term 
objectives, surpassing the program 
goal that 80 percent of students 
would master 80 percent of their 
objectives. Over 76 percent of 
students mastered all of their 
attempted objectives. 

The summer 1993 E.C.I. A. Chapter 
1, Part B, Institutional Facilities program 
staff included one coordinator, four 
supervisors, and 42 teachers for 15 
institutions for neglected and delinquent 
children, All program sessions were 
scheduled Monday through Friday, 
during various after-school hours. 
Teachers provided daily instructional 
sessions of three 45-minute periods. 
Teachers provided individualized 
occupational and academic instruction, 
based on each student's diagnosed 
strengths and weaknesses as measured 
by curriculum inventories. 



OREA's descriptive evaluation of the 
program, based on interviews, surveys 
of staff, and observations of classes, 
indicated that the program was fully 
implemented. Most teachers 
emphasized individual instruction and 
also included small group instruction. 
Only a few teachers emphasized whole 
group approaches. Teachers generally 
developed instruction to meet the 
individual needs and interests of 
students. Teachers' goals emphasized 
improving academic and daily life skills 
among students. 

This is the second year of 
implementation of the program's 
transition in leadership and vision. This 
transition has included congruence 
(Chapter I instruction complementary to 
day school instruction with a largely 
academic/occupational/career 
emphasis); use of individualized reading 
diagnostic inventories; replacement of 
the Life Skills Curriculum with the 
Essential Learning Outcomes 
Curriculum; and creation of a computer 
database for payroll, attendance, 
agencies, sites, and students. 

OREA's evaluation reflected the 
following program strengths: a 
cooperative and supportive agency 
staff; use of computers, software, and 
training; special programming (such as 
ENACT-a theater arts group); excellent 
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rapport between teachers and students; 
and materials and equipment generally 
available and sufficient. Students 
showed various academic accomp- 
lishments, including improving academic 
skills, passing exams, college 
acceptance, grade promotion, and the 
development of positive attitudes 
concerning personal growth, education, 
and work careers. 

OREA's evaluation did not revea! 
any major weaknesses in the program, 
although supervisors and staff did 
suggest several improvements to the 
program. Teachers expressed various 
problems concerning personal needs 
and habits of students and lack of 
support of agency staff which the 
program has limited capacity and 
resources to control although they do 
effect program success. Some teachers 
expressed concern about agency staff 
not being involved in motivating 
students to attend instructional 
sessions; the personal problems of 
students, such as bad eating habits, 
transitional placement in the 
institutions, and behavioral and 
emotional problems. Other problems the 
program has greater ability to affect 
concern the lack of information about 
students' day school attendance and 
performance; the lack of computers, 
software, and training at some sites; 
the need for more curriculum choices, 
such as instruction related to daily life 
and parenting skills; and the extensive 
use of time teachers are required to 
spend on non-instructional matters such 
as paperwork and ordering materials 
and supplies. 



Based on the findings of this 
evaluation, OREA recommends that the 
program: 

• encourage more plannino and 
instructional sessions for teachers, 
supervisors, and agency staff. Since 
the IFP is limited in affecting the 
degree of agency staff involvement 
then such planning and instructional 
sessions would, at minimum, 
facilitate the sharing of ideas on a 
range of issues such as difficulties 
teachers may have dealing with 
students' emotional and behavioral 
problems, and the involvement of 
agency staff in student instruction; 

• introduce computer equipment 
(including software) and computer 
education at more sites to serve the 
needs of both regular and special 
education students; 

• expand curriculum inventories to 
include additional academic 
instruction, information regarding the 
availability of materials and other 
resources, and instruction related to 
daily life and parenting skills. 
Continue to include program 
offerings in the arts (such as 
ENACT). Teacher training should 
include more topics such as 
transitional occupational skills, 
computer training, and behavioral 
management; 

• encourage and provide incentives to 
teachers and supervisors to continue 
in the program, since a high staff 
retention rate seems to contribute to 
program success; 
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allot teachers a designated time (or 
more time overall) to handle non- 
instructional matters such as 
paperwork, selecting and ordering 
materials, and making contacts with 
students' day school. This would 
help prevent teachers from having 
to use instructional time that should 
be devoted to students. 
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I. INTRODUCTION 

This report presents the Office of Research, Evaluation, and Assessment's 
(OREA's) evaluation of the summer 1993, E.C.I. A. Chapter 1, Part B, Institutional 
Facilities program. Citywide Programs/District 75 of the Division of Special 
Education (D.S.E.) designed and administered the program to provide instruction 
to neglected and delinquent children and adolescents residing in group homes and 
diagnostic centers. In summer 1993, the program was in its twenty-fourth year 
of implementation, and served approximately 500 children and adolescents in 15 
institutions. 

PROGRAM DESCRIPTION 

The program is designed to help students develop academic, vocational, 
and social skills so that they become productive citizens. This year's mandated 
program objective, as in previous years, was that 80 percent of the students 
would achieve 80 percent of their instructional objectives, as measured by OREA- 
and program-designed curriculum inventories. This exceeds the state criterion 
that 75 percent of the students achieve 75 percent of their instructional 
objectives. 

This is the second summer that the Institutional Facilities Program (IFP) has 
carried out its transition in leadership and focus. In 1992, Chapter I instruction 
was modified to be complementary to day-school instruction, with a largely 
academic/occupational/career emphasis in order to achieve a level of congruence 
between mainstream and program students' modes of instruction. This process 
serves as a link between the core classroom and support programs like this one. 
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Other changes implemented during this transition phase included the use of 
individualized reading diagnostic inventories, replacement of the Life Skills 
Curriculum with the Essential Learning Outcomes (ELO) Curriculum, and creation 
of a computer data base for payroll, attendance, agencies, sites, and shared 



The following presents the Institutional Facilities program instructional 
objectives, which have not changed since the implementation of the congruence 



IN STRUCTIONAL OBJECTIVES 

Academic Attainment 

1. To improve overall achievement in reading, writing, and mathematics. 

2. To improve student achievement by linking the core classroom 
program and the support programs. 

3. To assist students in organizing and budgeting their time efficiently 
for the completion of their school tasks. 

4. To help residents develop strategies needed for completion of 
assignments and to foster methodologies for improving study skills, 

5. To provide students with additional instructional time in order that 
they be better prepared for the following types of examinations: 

Standardized reading and mathematics examinations 

School-made class, mid-term, and final examinations 

Regents Competency Tests 

Proficiency Examinations 

Regents Examinations 

PSATs 

SATs 

Other Achievement Tests 

6. To assist sti. dents having difficulties with specific subjects. 



students. 



focus. 
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Career Building 



1 . To provide such activities as encouraging introspection, gathering of 
information, and self-discovery so as to enable students to relate 
tentative ca jr plans to their education, training, and future 
employmen 

2. To help students gain an understanding of the personal 
characteristics and qualities needed to be successfully employed. 

Social Skills 

1. To assist students in acquiring the knowledge, motivation, and 
abilities needed to carry out responsibilities related to family life, 
social relationships, marriage, and future parenthood. 

PROGRAM EVALUATION 

OREA assessed the educational approaches used by teachers, the quality of 
support provided by agency staff, and student mastery of individualized 
objectives. 

Evaluation Questions 

In order to carry out this assessment, OREA evaluated responses to the 
following specific questions: 

Program Implementation 

• What were the characteristics of participating students? 

• What were the characteristics, training activities, and communication 
patterns of program staff? 

• What format, activities, curriculum inventories, materials, and settings 
were used for instructional purposes? 

Program Outcomes 

• Did the program meet its mandated goal that 80 percent of the students 
would meet 80 percent of their attempted instructional objectives, as 
measured by the curriculum inventories? 
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Evaluation Activities 



• Teachers used OREA-designed student data retrieval forms (D.R.F.'s) to 
record student progress. The D.R.F.'s were either submitted to the 
program coordinator or mailed directly to OREA at the end of the summer. 
OREA received 492 D.R.F.'s. 

• OREA-developed surveys were sent to all of the teachers to record teacher 
perceptions of the extent of program implementation and effectiveness, 
instructional materials used, staff collaboration, and staff development. 
Thirty-three (79 percent) of 42 teachers responded to the surveys. 

• OREA developed teacher interview forms for consultants to use during site 
visits to record teacher perceptions of the program. This included general 
implementation and instructional format, activities, and materials; teachers' 
rapport with site staff; and teachers' recommendations for future program 
cycles. Fourteen teachers were interviewed. 

• Evaluators used OREA-designed site observation forms to record a 
description of the instructional setting, teaching methods, and lesson 
content. Several sites in all five boroughs were visited. 

Data Analysis 

OREA evaluators conducted a content analysis of program implementation 
information gathered in the teacher interviews and classroom observations, and a 
quantitative analysis of student characteristics and achievement information 
collected from the student D.R.F.'s, teacher surveys, staff surveys, and 
supervisor surveys. 
RFPORT FORMAT 

Chapter II describes program implementation, and Chapter III describes 
program outcomes. Chaptei IV presents OREA's conclusions and 
recommendations. This report relies largely on tables to present the data. 



4 

14 



II. PROGRAM IMPLEMENTATION 



SITES AND CHARACTERISTICS OF STUDENTS 

Table 1 lists the 1 5 institutional sites and the number of students at each site 
for whom D.R.F.'s were received. Each institution was composed of a number of 
residential sites. Program students included children and adolescents who <vere 
juvenile offenders in detention centers prior to judicial placement, pregnant 
teenagers in maternity centers awaiting the birth of their children, and students 
residing in public and private residential homes and institutions. The number of 
students at each institution ranged from 8 to 106, with an average of 31 
students. The ages of students ranged from 5 to 21 . Fifty-two percent were 
male and 48 percent were female. 
TEACHERS' PERCEPTIONS 
Survey 

Table 2 presents survey data related to teachers' perceptions of student/staff 
and facility characteristics, teaching objectives, instructional approaches, program 
strengths and weaknesses, and teachers' suggestions for improvements. 

As indicated in the 1992-93 report, data regarding the length of time teachers 
have been in the program indicate a high rate of teacher retention over the years. 
On average, teachers have been teaching for 1 5 years and have been in the 
program for nearly six years, about the same as last summer. High retention may 
in general reflect on teachers' overall satisfaction with the program. 
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TABLE 1 



STUDENTS SERVED, BY INSTITUTION* 
(N = 471) 



Institution 


Number of 
Students 


Percent 


Abbott House 


16 


3.4 


Catholic Child Care 


23 


4.9 


Latnoiic uu ^roian oocieiy 


8 


1.7 


v^enXCi TOT v«»nillJioii gnu rainiiy 


33 


7.0 


Child Welfare Administration 


I Uo 


00 5 


Dept. ot juvenue juoiiue 


14 


3.0 


Division for Youth 


17 


3.6 


tdwm vjOuiq oervices 


29 


6.2 


Good Shepherd Services 


48 


10.2 


Jewish Board Family and Children Services 


29 


6.2 


Inwood House 






Louise Wise Services 


10 


2.1 


New York Foundling Hospital 


23 


4.9 


Spofford Juvenile Center 


77 


16.3 


St. Dominic's Home 


14 


3.0 


Total: 


471 


100.0 



Oat* wart not raportad for on* institution: Rosalia Hall. 
Data miaaing for 21 caaaa. 

Sourca: Studant Data Ratriaval Forma 



ERIC 



6 

16 




00 



LU 



LU 
CO 



Adequacy of facilities was given a rating of about 4.5", slightly higher than 
last summer. Instruction mainly took place in classrooms (40 percent), dining 
rooms (29 percent), and living rooms (1 1 percent). Teachers' instructional goals 
emphasized pre-vocational education and the improvement of academic and daily 
life skills. The most effective classroom approach for implementing these goals 
was reported to be individualized instruction. The least effective was whole class 
or group instruction. Effective classroom activities, according to the teachers, 
included reading and math activities, writing projects, and the use of computers. 

In general, teachers' perceptions of the program's implementation were very 
positive. Materials and equipment were largely sufficient and available, receiving 
a rating of 4.2. The degree of rapport between agency staff and teachers was 
rated as excellent (4.8). Training and program support were viewed by teachers 
as extremely helpful. Usefulness of training, supervisor support, and work- 
shop/special staff contact were each rated highly (4.0). 

Teachers indicated several innovative aspects of the program, including 
computer instruction, use of such materials as audiovisual equipment and high 
interest materials, and involvement in the arts (such as with ENACT, a theater 
arts group). Suggestions for program improvement stressed the need for more 
computer equipment and software, and increased computer education. Teachers 
also suggested that agency staff be more involved with motivating students to 
attend instructional sessions. Without providing a solution, some 
teachers expressed concern about the instability and transient nature of the 

" All ratings mentioned in this report are based on a scale of 1 (most negative 
category) to 5 (most positive category). 

8 

19 



population, which contributed to their difficulties in dealing with behavioral and 
emotional problems of students. 

Table 3 summarizes the instructional materials and equipment used, and the 
patterns of staff communication. The most effective materials and equipment 
were reported to be basic reading and reference materials, workbooks and 
worksheets, computers and computer software, and audio-visual equipment, 
The sufficiency and availability of materials were rated highly (4,2). Teacher 
training and program support were also rated very positively. Suggestions for 
new training topics included behavior management, computer training, vocational 
education and training, and obtaining better or more resources. Teachers 
recommended that ELO's or curriculum inventories be expanded to include basic 
academic instruction and information regarding the availability of materials. 

In terms of staff communication, the most frequently discussed topic with 
agency staff was behavior/classroom management, followed by attendance, 
motivational and scheduling problems with students, and student progress and 
evaluation. Teachers rated the degree of rapport between teachers and agency 
staff very highly (4.8). Rapport was reported to be generally very positive. 
Agency staff were available and coor ative and provided encouragement to 
students. 

Teacher Interviews 

Interviews with 14 teachers reinforced much of the teacher survey findings, 
as indicated in Table 4. For instance, overall goals were reported to be the 
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improvement of basic academic skills, such as reading and math, and 

enhancement of daily life skills. 

In regard to instructional approach, all but one of the teachers interviewed 

reported working with students on an individual basis. Most of them (10) also 

reported using a small group approach to instruction. Only a few (3) reported 

instructing students in a large group setting. 

The nature of the supervisors' role was cited by most teachers as ensuring 

the needs, goals, and progress of students. Supervisors were also reported by 

most teachers to regularly observe instructional sessions. In general, supervisors 
were involved in lesson preparation, paperwork and procedures, and training in 
the use of materials. 

The most positive aspects of the program as cited by the teachers in 
interviews included the good rapport and cooperation between students and 
teachers. Teachers also believed that developing students' academic and daily 
life skills was a beneficial aspect of the program. Suggestions for improvement 
included having more computers, software and training, the allocation of more 
instructional materials, more curriculum choices such as instruction related to 
daily life and mothering skills, and the designation of more time to handle non- 
instructional matters such as paperwork and ordering materials and supplies- 
Supervisors 1 Perceptions 

Table 5 reports on the information gathered from a survey of two (out of 
four) program supervisors. On average, these supervisors had nearly 12 years of 
supervisory experience in Special Education, and six years in IFP. 
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Supervisors' reported goals included supervising instructional activities 
according to the handbook of objectives, and insuring good teacher/agency 
relations. Supervisors rated the degree to which overall goals were achieved very 
highly (5.0). Supervisors' activities included ensuring appropriate instruction, 
monitoring paperwork, and resolving problems among staff, students, and 
teachers. Supervisors rated the degree to which activities and methods were 
implemented very highly (5.0). 

Training of teachers by supervisors was rated as useful (4.0). Topics covered 
included agency /teacher relationships, materials, and program operation and 
guidelines. The usefulness of the training received by supervisors in preparation 
of their roles was rated positively at 4.0. 

The supervisors generally agreed that the quality of the working relationship 
with agency staff was excellent, rating this a 5.0. Materials and equipment were 
rated satisfactory (4.0). Staffing was generally sufficient, being rated a 5.0. 

Overall success of the program received a 4.5 rating. Supervisor?; reported 
that the program was fully implemented as planned, and that the use of 
computers was an innovative aspect of the program that worked well with 
students. Few other innovations were reported. 
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III. PROGRAM OUTCOMES 

Table 6 lists the percentages of objectives mastered by the total sample 
population. Data indicated that more than 82 percent of the students mastered 
80 percent or more of their individual objectives, and over 76 percent of the 
students mastered all of their attempted individual objectives. 

Table 7 presents particular student accomplishments. Overall, 823 
accomplishments were reported/ They included particular accomplishments 
such as obtaining employment, passing exams, completing high school, and 
getting accepted to college, as well as general attitudinal changes such as 
developing positive values concerning personal and educational issues. The 
development of positive attitudes concerning education, work, and careers, as 
well as improved self-esteem and interpersonal relationships, represented 40 
percent of the student accomplishments reported. Nearly 35 percent of all 
student accomplishments reported concerned improved academic skills and other 
academic accomplishments. 



■ This suggests that each student for whom data were reported by the teachers 
could have had multiple accomplishments. 

15 



29 



TABLE 6 

Percentages of Objectives Mastered 



(N = 483) 



Percent 


Number of 


Percent of 


Cumulative 


Cumulative 


Mastery 


Students 


Students 


Number of 


Percent 






Students 




100 


368 


76.2 


368 


76.2 


90-99 


12 


2.5 


380 


78.7 


80-89 


18 


3.7 


393 


82.4 


60-79 


44 


9.1 


442 


91.5 


0-59 


36 


7.5 


478 


99.0 


0 


5 


1.0 


483 


100.0 


Total 


483 









Source: Student Deta Retrieval Forms 

• Over 82 percent (398) of the students mastered 80 percent or more of their individual objectives. 

• Over 76 percent (332) of the studente mastered all of thair attempted individual objectives. 
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TABLE 7 



PROGRAM-RELATED STUDENT ACCOMPLISHMENTS 
(N = 823-accomplishments recorded) 



PROGRAM-RELATED GOAL STUDENTS 



Number Percentage 



a v/nrATinMAl /ArADPMir ACHIEVEMENTS 






Obtained off-site employment 


1 u 




Obtained on-site jobs 


14 


1.7 


Promoted a grade in day school 


12 


1.5 


Passed other academic exam 


6 


.7 


Other academic accomplishments 


122 


14.8 


Accepted to college program 


9 


1.1 


Passed regents exam 


5 


.6 


Entered or re-entered I.Iih school 


9 


1.1 


Obtained on-site jobs 


14 


1 .7 


Completed GED 


5 


.6 


Completed high school 


1 


.1 


Passed licensing exam 


5 


.6 


Improved academic skills 


159 


19.3 



B. STUDENT ATTITUDINAL CHANGES 

Developed positive vaiues 177 21 5 

concerning self-esteem and 
interpersonal relationships 

Developed positive values 1 75 21 3 

concerning education, work, 
careers 

Accomplished other program- 1 00 1 22 

rela ted attainments 

Source: Teache^urveys 

• Over 40 percent of all student accomplishments reported by teachers were the 
development of positive values concerning education, work, careers, self-esteem, 
and interpersonal realtionships. 

• Nearly 35 percent of all student accomplishments concerned improved academic 
skills and other academic accomplishments. 
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IV. CONCLUSIONS AND RECOMMENDATIONS 

CONCLUSIONS 

Information obtained b/ the Office of Research, Evaluation, and Assessment 
revealed that the state-mandated goal of 75 percent of students achieving 75 
percent of their objectives was met. The more stringent program goal of 80 
percent of students achieving 80 percent of their objectives was ilso met. 
Overall, more than 82 percent of the students reached or exceeded 80 percent of 
their attempted objectives, and over 76 percent of the students achieved all of 
their attempted objectives. 

Analyses of survey and interview data indicated that most instruction took 
place in classrooms, and that teachers worked with student: individually and in 
small groups. Program goals included improving students' academic skills and 
daily life skills, and providing prevocational training. Various activities were 
implemented in pursuit of these goals, including hands-on activities, writing 
projects, and the use of comp' ..ers. Teachers and supervisors emphasized that 
computers were very successful in facilitating implementation of the program's 
educational goals, and recommended that more computers, computer equipment, 
software packages, and computer training be provided. Instructional materials 
and equipment, in general, were sufficient and available. Rapport among 
teachers, supervisors, and agency staff, as well as between students and 
teachers, was reported as generally positive. 
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Very few weaknesses in the program were indicated by teachers and 
supervisors. However, some teachers expressed various concerns. Some of 
these concerned personal problems and habits of students and lack of agency 
staff cooperation and involvement which the IFP has limited control over in terms 
of resources and program structure. For example, in teacher surveys, teachers 
reported concern tbout staff not being involved in motivating students to attend 
instructional sessions; personal problems of students which get in the way of 
instruction, such as transitional placement in the institutions; and behavioral and 

emotional problems. 

Teachers expressed other concerns that IFP has better capacity to address. 
In teacher interviews, teachers indicated the need for more information about 
students' day school attendance and performance; more curriculum choices, such 
as instruction related to daily life and parenting skills; and the designation of more 
time to spend on non-instructional matters such as paperwork and ordering 
materials and supplies. In both teacher surveys and teacher interviews, teachers 
indicated the need for more computers, software, and training. 
RFP.OMMENDATIONS 

Based on the findings of this evaluation, OREA recommends that the 

program: 

• encourage more planning and instructional sessions for teachers, supervisors, 
and agency staff. Since the IFP is limited in affecting the degree of agency 
staff involvement then such planning and instructional sessions would, at 
minimum, facilitate the sharing of ideas on a range of issues such as 
difficulties teachers may have dealing with students' emotional and behavioral 
problems, and the involvement of agency staff in student instruction; 
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• introduce computer equipment (including software) and computer education 
at more sites to serve the needs of both regular and special education 
students; 

• expand curriculum inventories to include additional academic instruction, 
information regarding the availability of materials and other resources, and 
instruction related to daily life and parenting skills. Continue to include 
program offerings in the arts (such as ENACT), Teacher training should 
include more topics such as transitional occupational skills, computer training, 
and behavioral management; 

• encourage and provide incentives to teachers and supervisors to continue in 
the program, since a high staff retention rate seems to contribute to program 
success; 

• allot teachers a designated time (or more time overall) to handle non- 
instructional matters such as paperwork, selecting and ordering materials, 
and making contacts with students' day school. This would help prevent 
teachers from having to use instructional time that should be devoted to 
students. 
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